Method and system for data processing for text classification of a target domain

ABSTRACT

The disclosed embodiments illustrate methods of data processing for text classification of a target domain. The method includes generating a plurality of clusters from a plurality of first text segments corresponding to a plurality of source domains, based on an association of the plurality of first text segments with a plurality of categories. The method further includes computing a similarity score of each of a plurality of second text segments corresponding to the target domain for each of the plurality of clusters. The method further includes identifying a pre-specified count of clusters from the plurality of clusters, based on the computed similarity score. Further, the method includes training a first classifier by utilizing first text segments in the identified pre-specified count of clusters, wherein the trained first classifier is utilized to automatically classify the plurality of second text segments into categories associated with the identified pre-specified count of clusters.

TECHNICAL FIELD

The presently disclosed embodiments are related, in general, to dataprocessing. More particularly, the presently disclosed embodiments arerelated to methods and systems for data processing for textclassification of a target domain.

BACKGROUND

Mostly, machine learning (ML) based automation systems are supervisedsystems, and primarily rely on labeled examples coded by analysts forlearning specific tasks, such as classification. The idea to useML-based automation systems has led to significant contributions todomain adaptation and transfer learning (DA/TL) techniques. The DA/TLtechniques leverage knowledge from one or multiple previous (source)domains to learn the task in the new (target) domain.

Advancements in DA/TL techniques are also exploited in same-domain andcross-domain text classification. However, in certain scenarios, theimplementation of the DA/TL techniques in cross-domain classificationmay be cumbersome due to dissimilar data distributions and disparatelabel sets associated with different source domains. Thus, an advancedtechnique may be desired that may efficiently perform cross-domainclassification irrespective of the dissimilarity in data distributionsand disparity in label sets associated with different source domains.

Further limitations and disadvantages of conventional and traditionalapproaches will become apparent to one of skill in the art, throughcomparison of described systems with some aspects of the presentdisclosure, as set forth in the remainder of the present application andwith reference to the drawings.

SUMMARY

According to embodiments illustrated herein, there is provided a methodof data processing for text classification of a target domain. Themethod includes generating, by one or more processors, a plurality ofclusters from a plurality of first text segments corresponding to aplurality of source domains, based on an association of the plurality offirst text segments with a plurality of categories, wherein a cluster inthe plurality of clusters is associated with a category in the pluralityof categories. The method further includes computing, by the one or moreprocessors, a similarity score of each of a plurality of second textsegments corresponding to the target domain for each of the plurality ofclusters. The method further includes identifying, by the one or moreprocessors, a pre-specified count of clusters from the plurality ofclusters, based on the computed similarity score, wherein the identifiedpre-specified count of clusters encompass maximum count of the pluralityof second text segments. The method further includes training, by theone or more processors, a first classifier by utilizing first textsegments in the identified pre-specified count of clusters, wherein thetrained first classifier is utilized to automatically classify theplurality of second text segments into categories associated with theidentified pre-specified count of clusters.

According to embodiments illustrated herein, there is provided a systemdata processing for text classification of a target domain. The systemincludes one or more processors configured to generate a plurality ofclusters from a plurality of first text segments corresponding to aplurality of source domains, based on an association of the plurality offirst text segments with a plurality of categories, wherein a cluster inthe plurality of clusters is associated with a category in the pluralityof categories. The one or more processors are further configured tocompute a similarity score of each of a plurality of second textsegments corresponding to the target domain for each of the plurality ofclusters. The one or more processors are further configured to identifya pre-specified count of clusters from the plurality of clusters, basedon the computed similarity score, wherein the identified pre-specifiedcount of clusters encompass maximum count of the plurality of secondtext segments. The one or more processors are further configured totrain a first classifier by utilizing first text segments in theidentified pre-specified count of clusters, wherein the trained firstclassifier is utilized to automatically classify the plurality of secondtext segments into categories associated with the identifiedpre-specified count of clusters.

According to embodiments illustrated herein, there is provided acomputer program product for use with a computing device. The computerprogram product comprises a non-transitory computer readable mediumstoring a computer program code for data processing for textclassification of a target domain. The computer program code isexecutable by one or more processors in the computing device to generatea plurality of clusters from a plurality of first text segmentscorresponding to a plurality of source domains, based on an associationof the plurality of first text segments with a plurality of categories,wherein a cluster in the plurality of clusters is associated with acategory in the plurality of categories. The computer program code isfurther executable by the one or more processors to compute a similarityscore of each of a plurality of second text segments corresponding tothe target domain for each of the plurality of clusters. The computerprogram code is further executable by the one or more processors toidentify a pre-specified count of clusters from the plurality ofclusters, based on the computed similarity score, wherein the identifiedpre-specified count of clusters encompass maximum count of the pluralityof second text segments. The computer program code is further executableby the one or more processors to train a first classifier by utilizingfirst text segments in the identified pre-specified count of clusters,wherein the trained first classifier is utilized to automaticallyclassify the plurality of second text segments into categoriesassociated with the identified pre-specified count of clusters.

BRIEF DESCRIPTION OF DRAWINGS

The accompanying drawings illustrate the various embodiments of systems,methods, and other aspects of the disclosure. Any person with ordinaryskills in the art will appreciate that the illustrated elementboundaries (e.g., boxes, groups of boxes, or other shapes) in thefigures represent one example of the boundaries. In some examples, oneelement may be designed as multiple elements, or multiple elements maybe designed as one element. In some examples, an element shown as aninternal component of one element may be implemented as an externalcomponent in another, and vice versa. Furthermore, the elements may notbe drawn to scale.

Various embodiments will hereinafter be described in accordance with theappended drawings, which are provided to illustrate the scope and not tolimit it in any manner, wherein like designations denote similarelements, and in which:

FIG. 1 is a block diagram that illustrates a system environment, inwhich various embodiments can be implemented, in accordance with atleast one embodiment;

FIG. 2 is a block diagram that illustrates an application server, inaccordance with at least one embodiment;

FIG. 3A is a block diagram that illustrates an exemplary scenario of aplurality of first text segments corresponding to a plurality of sourcedomains, in accordance with at least one embodiment;

FIG. 3B is a block diagram that illustrates an exemplary scenario of aplurality of second text segments corresponding to a target domain, inaccordance with at least one embodiment;

FIG. 4 is a flowchart that illustrates a method of data processing fortext classification of a target domain, in accordance with at least oneembodiment;

FIG. 5A is a block diagram that illustrates an exemplary scenario fortraining a first classifier for text classification of a target domain,in accordance with at least one embodiment; and

FIG. 5B is a block diagram that illustrates an exemplary scenario forclassification of a plurality of second text segments by utilizing atrained first classifier, in accordance with at least one embodiment.

DETAILED DESCRIPTION

The present disclosure is best understood with reference to the detailedfigures and description set forth herein. Various embodiments arediscussed below with reference to the figures. However, those skilled inthe art will readily appreciate that the detailed descriptions givenherein with respect to the figures are simply for explanatory purposesas the methods and systems may extend beyond the described embodiments.For example, the teachings presented and the needs of a particularapplication may yield multiple alternative and suitable approaches toimplement the functionality of any detail described herein. Therefore,any approach may extend beyond the particular implementation choices inthe following embodiments described and shown.

References to “one embodiment,” “at least one embodiment,” “anembodiment,” “one example,” “an example,” “for example,” and so on,indicate that the embodiment(s) or example(s) may include a particularfeature, structure, characteristic, property, element, or limitation,but that not every embodiment or example necessarily includes thatparticular feature, structure, characteristic, property, element, orlimitation. Furthermore, repeated use of the phrase “in an embodiment”does not necessarily refer to the same embodiment.

Definitions: The following terms shall have, for the purposes of thisapplication, the meanings set forth below.

A “user-computing device” refers to a computer, a device (that includesone or more processors/microcontrollers and/or any other electroniccomponents), or a system (that performs one or more operations accordingto one or more programming instructions/codes) associated with a user.Examples of the user-computing device may include, but are not limitedto, a desktop computer, a laptop, a personal digital assistant (PDA), amobile device, a smartphone, and a tablet computer (e.g., iPad® andSamsung Galaxy Tab®).

A “plurality of source domains” corresponds to a plurality of technicalor business fields to which a plurality of first text segments isrelated. In an embodiment, the plurality of first text segmentscorresponding to the plurality of source domains may be associated witha plurality of categories. In an embodiment, the categorized pluralityof first text segments may be utilized to train a classifier forclassification of text segments into the plurality of categories.

A “plurality of categories” corresponds to a plurality of labels/tagsassociated with text content. In an embodiment, the text content may beclassified into the plurality of categories based on one or morefeatures associated with the text content, such as lexical features,semantic features, syntactic features and/or the like. In an embodiment,the text content may be manually categorized into the plurality ofcategories. In another embodiment, the text content may be categorizedinto the plurality of categories by utilizing a trained classifier. Inan embodiment, a plurality of second text segments may be classifiedinto one or more categories of the plurality of categories associatedwith a plurality of first text segments.

A “plurality of first text segments” corresponds to text contentassociated with a plurality of source domains. Each of the plurality offirst text segments is associated with a category of a plurality ofcategories. In an embodiment, the plurality of first text segments maybe utilized to train a classifier to classify a plurality of second textsegments corresponding to a target domain. Examples of the plurality offirst text segments may include a comment, a post, a share, a tweet,and/or the like by one or more users on a social networking site. Inanother embodiment, the plurality of first text segments may begenerated by converting a plurality of first audio segments into text byutilizing one or more speech to text conversion techniques.

A “plurality of clusters” corresponds to a plurality of groups or acollection comprising first text segments. In an embodiment, a pluralityof first text segments is tessellated into the plurality of clustersbased on an association of the plurality of first text segments with aplurality of categories. Each of the plurality of clusters is associatedwith a category of the plurality of categories.

A “centroid” of a cluster refers to an average of scores associated withtext segments in the cluster.

A “score” corresponds to a measure of importance of a keyword in a textsegment of a plurality of text segments. In an embodiment, the score ofa keyword is directly proportional to a number of times the keywordappears in the text segment and inversely proportional to a number oftimes the keywords appear in the plurality of text segments. Forexample, a first keyword “attention” appears twice in a text segmentcomprising 10 keywords and further appears in 8 segments in a pluralityof text segments comprising 20 text segments. Similarly, a secondkeyword “the” appears twice in the text segment comprising 10 keywordsand further appears in 15 text segments in the plurality of textsegments comprising 20 text segments. Thus, the score (i.e., 0.5) forthe first keyword “attention” is higher compared with the score (i.e.,0.267) for the second keyword “the.”

A “target domain” corresponds to a technical or business field to whicha plurality of second text segments is related. In an embodiment, theplurality of second text segments associated with the target domain isclassified into one or more categories by utilizing a trainedclassifier. For example, a plurality of second text segmentscorresponding to a domain “books” is classified into one or morecategories, such as “science,” “history,” “geography” and “mathematics,”by utilizing a trained classifier.

A “plurality of second text segments” corresponds to text contentassociated with a target domain. The plurality of second text segmentsis independent of any category. In an embodiment, the plurality ofsecond text segments may be classified into one or more categories byutilizing a trained classifier. Examples of the plurality of second textsegments may include a comment, a post, a share, a tweet, and/or thelike by one or more users on a social networking site. In anotherembodiment, the plurality of second text segments may be generated byconverting a plurality of second audio segments into text by utilizingone or more speech to text conversion techniques.

A “classifier” refers to a mathematical model that may be configured toclassify text segments in a plurality of categories. In an embodiment,the classifier is trained based on training data. Examples of theclassifier may include, but are not limited to, a Support Vector Machine(SVM), a Logistic Regression, a Bayesian Classifier, a Decision TreeClassifier, a Copula-based Classifier, a K-Nearest Neighbors (KNN)Classifier, or a Random Forest (RF) Classifier.

“Training” refers to a process of updating/tuning a classifier usingtraining data such that the classifier, once trained, may be able toclassify the target data into a category of a plurality of categories.

A “weight” corresponds to a relevance score assigned to a first textsegment to be used as training data to classify a plurality of secondtext segments. In an embodiment, a first text segment with a higherweight may represent that the first text segment is more relevant forclassifying the plurality of second text segments as compared with otherfirst text segments. In an embodiment, a classifier may be utilized toassign the weight to first text segments associated with a pre-specifiedcount of clusters.

A “tabular data structure” corresponds to a matrix representation ofdata. The tabular data structure may comprise one or more rows and oneor more columns. In an embodiment, a count of the one or more rows inthe tabular data structure may be equal to a count of second textsegments in a plurality of second text segments corresponding to atarget domain. In an embodiment, a count of the one or more columns inthe tabular data structure may be equal to a count of categories in aplurality of categories associated with a plurality of first textsegments corresponding to a plurality of source domains. In anembodiment, an element in a row in the tabular data structure maycorrespond to a similarity score.

A “pre-specified count of clusters” refers to a count of clustersidentified from a plurality of clusters associated with a plurality ofsource domains. In an embodiment, a service provider may specify thecount. Each of the pre-specified count of clusters may be associatedwith a category. Further, each of the pre-specified count of clustersmay comprise first text segments associated with the correspondingcategory.

A “similarity score” refers to a score that indicates a degree ofsimilarity between one or more text segments. In an embodiment, twosimilar text segments may have a higher similarity score compared withtwo dissimilar text segments. In an embodiment, the similarity score maybe computed for each of a plurality of second text segments for each ofa plurality of clusters.

FIG. 1 is a block diagram of a system environment in which variousembodiments may be implemented. With reference to FIG. 1, there is showna system environment 100 that includes a user-computing device 102, anapplication server 104, a database server 106, and a network 108.Various devices in the system environment 100 may be interconnected overthe network 108. FIG. 1 shows, for simplicity, one user-computing device102, one application server 104, and one database server 106. However,it will be apparent to a person having ordinary skill in the art thatthe disclosed embodiments may also be implemented using multipleuser-computing devices, multiple application servers, and multipledatabase servers, without departing from the scope of the disclosure.

In an embodiment, the user-computing device 102 may refer to a computingdevice (associated with a user) that may be communicatively coupled tothe network 108. The user-computing device 102 may include one or moreprocessors and one or more memories. The one or more memories mayinclude computer readable codes and instructions that may be executableby the one or more processors to perform predetermined operations asspecified by the user. The predetermined operations may includetransmitting a plurality of first text segments and/or a plurality ofsecond text segments to the database server 106, over the network 108.

The user-computing device 102 may correspond to a variety of computingdevices such as, but not limited to, a laptop, a PDA, a tablet computer,a smartphone, and a phablet.

A person having ordinary skill in the art will understand that the scopeof the disclosure is not limited to the utilization of theuser-computing device 102 by a single user. In an embodiment, theuser-computing device 102 may be utilized by more than one users totransmit the plurality of first text segments and/or the plurality ofsecond text segments to another device, such as the application server104, via the network 108.

In an embodiment, the application server 104 may refer to a computingdevice or a software framework hosting an application or a softwareservice that may be communicatively coupled to the network 108. In anembodiment, the application server 104 may be implemented to executeprocedures such as, but not limited to, programs, routines, or scriptsstored in one or more memories for supporting the hosted application orthe software service. In an embodiment, the hosted application or thesoftware service may be configured to perform one or more predeterminedoperations. In an embodiment, the one or more predetermined operationsmay include training a first classifier to classify the plurality ofsecond text segments corresponding to a target domain.

In an embodiment, the application server 104 may be configured toretrieve the plurality of first text segments corresponding to aplurality of source domains and the plurality of second text segments.Prior to the retrieval of the plurality of first text segments, theapplication server 104 may identify the plurality of source domains,relevant to the target domain. Each of the relevant source domains maybe associated with one or more categories. Further, each of the relevantsource domains may constitute one or more first text segments.Furthermore, a first text segment of the one or more first text segmentsin a source domain may be associated with a category in the one or morecategories associated with the corresponding source domain.Collectively, the one or more categories associated with each of therelevant source domains are referred to as a plurality of categories andthe one or more first text segments associated with each of the relevantsource domains are referred to as the plurality of first text segments.Thus, the plurality of first text segments is associated with theplurality of categories. In an embodiment, the application server 104may determine a score for each of the plurality of first text segmentsand the plurality of second text segments by utilizing one or morescoring algorithms known in the art. Examples of the one or more scoringalgorithms may include, but are not limited to, Term frequency-Inversedocument frequency (TF-IDF) algorithm.

In an embodiment, the application server 104 may be configured togenerate a plurality of clusters from the plurality of first textsegments, based on the association of the plurality of first textsegments with the plurality of categories, such that a cluster in theplurality of clusters is associated with a category in the plurality ofcategories. In addition, each cluster may comprise first text segmentsfrom the plurality of first text segments that are associated with thecorresponding category. Therefore, a count of clusters in the pluralityof clusters may be equal to a count of categories in the plurality ofcategories. In an embodiment, the application server 104 may beconfigured to determine a centroid for each of the plurality ofclusters. The application server 104 may utilize the score associatedwith one or more of the plurality of first text segments in each of theplurality of clusters for determining the centroid for each of theplurality of clusters. For example, a centroid for a first cluster inthe plurality of clusters is determined based on the score (e.g., TF-IDFscore) of each of the first text segments in the first cluster.

In an embodiment, the application server 104 may be configured tocompute a similarity score of each of the plurality of second textsegments for each of the plurality of clusters. The application server104 may utilize the score (e.g., TF-IDF score) of each of the pluralityof second text segments and the centroid of each of the plurality ofclusters for the computation of the similarity score of each of theplurality of second text segments for each of the plurality of clusters.The application server 104 may utilize one or more similarity measures,known in the art, for the computation of the similarity score. Examplesof such one or more similarity measures may include, but are not limitedto, cosine similarity, Euclidian distance, and KL divergence. Further,the application server 104 may be configured to store the computedsimilarity score as a tabular data structure, such as a matrix, in thedatabase server 106. Each element in a row of the tabular data structuremay represent the similarity score between a second text segment in theplurality of second text segments and a cluster in the plurality ofclusters.

In an embodiment, the application server 104 may be configured toidentify a pre-specified count of clusters from the plurality ofclusters based on the computed similarity score. The application server104 may utilize one or more algorithms known in the art for theidentification of the pre-specified count of clusters. Examples of suchone or more algorithms may include, but are not limited to, maximumcoverage algorithm and greedy algorithm. In an embodiment, theidentified pre-specified count of clusters encompasses the maximum countof the plurality of second text segments (i.e., a count of second textsegments from the plurality of second text segments associated with theidentified pre-specified count of clusters is highest).

In an embodiment, the application server 104 may utilize first textsegments in the identified pre-specified count of clusters to train afirst classifier. The first text segments in the identifiedpre-specified count of clusters may correspond to a training set for thefirst classifier. In another embodiment, the application server 104 maydetermine a weight for one or more of the plurality of first textsegments associated with the identified pre-specified count of clustersby use of a second classifier. Thereafter, the application server 104may utilize the weighted first text segments in the identifiedpre-specified count of clusters to train the first classifier. Theweighted first text segments in the identified pre-specified count ofclusters may correspond to the training set for the first classifier. Inan embodiment, the application server 104 may utilize the trained firstclassifier to automatically classify the plurality of second textsegments in categories associated with the identified pre-specifiedcount of clusters.

The application server 104 may be realized through various types ofapplication servers such as, but are not limited to, a Java applicationserver, a .NET framework application server, a Base4 application server,a PHP framework application server, or any other application serverframework. The operation of the application server 104 has beendiscussed later in FIG. 2.

In an embodiment, the database server 106 may refer to a computingdevice that may be communicatively coupled to the network 108. In anembodiment, the database server 106 may be configured to store theplurality of first text segments, corresponding to the plurality ofsource domains, associated with the plurality of categories. In anembodiment, the database server 106 may be further configured to storethe plurality of second text segments, independent of the plurality ofcategories, associated with the target domain.

In an embodiment, a service provider may extract text content from oneor more websites by utilizing one or more techniques, such as webcrawling and/or the like. Examples of the text content may include acomment, a post, a share, a tweet, and/or the like shared by a pluralityof users on the social networking site. In another embodiment, theservice provider may extract audio content from the one or more websitesby utilizing one or more techniques, such as web crawling and/or thelike. Thereafter, the service provider may convert the extracted audiocontent into the text content by utilizing one or more speech to textconversion techniques. The service provider may further associate theextracted/converted text content with the plurality of source domainsassociated with the plurality of categories. The classified text contentmay correspond to the plurality of first text segments. Thereafter, theservice provider may store the plurality of first text segments in thedatabase server 106. In an embodiment, the service provider may extractnew text content associated with the target domain. The new text contentmay be independent of the plurality of categories. The service providermay store the new text content in the database server 106. Thus, the newtext content may correspond to the plurality of second text segments.

In an embodiment, the database server 106 may be further configured tostore the plurality of second text segments after the classification into the categories associated with the pre-specified count of clusters.

A person having ordinary skill in the art will appreciate that the scopeof the disclosure is not limited to realizing the application server 104and the database server 106 as separate entities. In an embodiment, thefunctionalities of the application server 104 can be integrated into thedatabase server 106.

The network 108 corresponds to a medium through which content andmessages flow among various devices of the system environment 100 (e.g.,the user-computing device 102, the application server 104, and thedatabase server 106). Examples of the network 108 may include, but arenot limited to, a Wireless Fidelity (Wi-Fi) network, a Wireless AreaNetwork (WAN), a Local Area Network (LAN), or a Metropolitan AreaNetwork (MAN). Various devices in the system environment 100 can connectto the network 108 in accordance with various wired and wirelesscommunication protocols such as Transmission Control Protocol andInternet Protocol (TCP/IP), User Datagram Protocol (UDP), and 2G, 3G, or4G communication protocols.

FIG. 2 is a block diagram that illustrates an application server, inaccordance with at least one embodiment. FIG. 2 has been described inconjunction with FIG. 1. With reference to FIG. 2, there is shown theapplication server 104 that may include a processor 202, a memory 204, atransceiver 206, a text categorizer 208, and an input/output unit 210.The processor 202 is communicatively coupled to the memory 204, thetransceiver 206, the text categorizer 208, and the input/output unit210.

The processor 202 includes suitable logic, circuitry, and/or interfacesthat are configured to execute one or more instructions stored in thememory 204. The processor 202 may further comprise an arithmetic logicunit (ALU) (not shown) and a control unit (not shown). The ALU may becoupled to the control unit. The ALU may be configured to perform one ormore mathematical and logical operations and the control unit maycontrol the operation of the ALU. The processor 202 may execute a set ofinstructions/programs/codes/scripts stored in the memory 204 to performone or more operations for the text classification. The processor 202may be implemented based on a number of processor technologies known inthe art. Examples of the processor 202 include, but are not limited to,an X86-based processor, a Reduced Instruction Set Computing (RISC)processor, an Application-Specific Integrated Circuit (ASIC) processor,and/or a Complex Instruction Set Computing (CISC) processor.

The memory 204 may be operable to store one or more machine codes,and/or computer programs having at least one code section executable bythe processor 202. The memory 204 may store the one or more sets ofinstructions that are executable by the processor 202, the transceiver206, the text categorizer 208, and the input/output unit 210. In anembodiment, the memory 204 may include one or more buffers (not shown).The one or more buffers may store one or more of the plurality of firsttext segments, the plurality of second text segments, the plurality ofcategories corresponding to the plurality of source domains and thetabular data structure. Some of the commonly known memoryimplementations include, but are not limited to, a random access memory(RAM), a read only memory (ROM), a hard disk drive (HDD), and a securedigital (SD) card. In an embodiment, the memory 204 may include the oneor more machine codes, and/or computer programs that are executable bythe processor 202 to perform specific operations. It will be apparent toa person having ordinary skill in the art that the one or moreinstructions stored in the memory 204 may enable the hardware of theapplication server 104 to perform the predetermined operations, withoutdeviating from the scope of the disclosure.

The transceiver 206 transmits/receives messages and data to/from variouscomponents, such as the user-computing device 102, and the databaseserver 106, of the system environment 100 over the network 108. In anembodiment, the transceiver 206 may be communicatively coupled to thenetwork 108. In an embodiment, the transceiver 206 may be configured toreceive the retrieved plurality of first text segments and the pluralityof the second text segments from the database server 106, over thenetwork 108. Examples of the transceiver 206 may include, but are notlimited to, an antenna, an Ethernet port, a USB port, or any other portthat can be configured to receive and transmit data. The transceiver 206receives and transmits the content/information/notifications, inaccordance with various communication protocols, such as TCP/IP, UDP,and 2G, 3G, or 4G communication protocols.

The text categorizer 208 may comprise suitable logic, circuitry,interfaces and/or code that may be configured to execute the one or moreinstructions stored in the memory 204 for text classification. In anembodiment, the text categorizer 208 may train the first classifier toautomatically classify the plurality of second text segments into thecategories associated with the identified pre-specified count ofclusters. In an embodiment, the text categorizer 208 may be realizedthrough either software technologies or hardware technologies known inthe art.

Though, the text categorizer 208 is depicted as independent from theprocessor 202 in FIG. 2, a person having ordinary skill in the art willappreciate that the text categorizer 208 may be implemented within theprocessor 202, without departing from the scope of the disclosure.

The input/output unit 210 may comprise suitable logic, circuitry,interfaces, and/or code that may be configured to provide an output tothe user. The input/output unit 210 comprises various input and outputdevices that are configured to communicate with the processor 202.Examples of the input devices include, but are not limited to, akeyboard, a mouse, a joystick, a touch screen, a microphone, a camera,and/or a docking station. Examples of the output devices include, butare not limited to, a display screen and/or a speaker.

The working of the application server 104 for text classification hasbeen explained later in FIG. 4.

FIG. 3A is a block diagram that illustrates a plurality of first textsegments corresponding to a plurality of source domains. FIG. 3A isdescribed in conjunction with FIG. 1 and FIG. 2. With reference to FIG.3A, there is shown a block diagram that illustrates an exemplaryassociation 300 a between an exemplary plurality of first text segmentsand an exemplary plurality of source domains. A person with ordinaryskills in the art will understand that for brevity, the plurality ofsource domains 302 a includes 3 source domains, the plurality ofcategories 302 b includes 9 categories, and the plurality of first textsegments 302c includes 10 first text segments. Notwithstanding, thedisclosure may not be so limited, and the subsequent steps of theflowchart 400 may be further applicable to each of the one or more textsegments of the text content, without deviating from the scope of thedisclosure.

Each source domain, such as “S₁”, “S₂”, and “S₃”, in the plurality ofsource domains 402 a is associated with one or more categories. Sourcedomain “S₁” is associated with the one or more categories, such as “C₁”,“C₂” and “C₃”. Source domain “S₂” is associated with the one or morecategories, such as “C₄” and “C₅”. Source domain “S₃” is associated withthe one or more categories, such as “C₆”, “C₇”, “C₈” and “C₉”.Collectively, the one or more categories associated with each of theplurality of source domains 302 a are referred to as the plurality ofcategories 302 b. Further, each category in the plurality of categories302 b is associated with one or more first text segments. For example,the categories “C₁”, “C₂”, and “C₃” are associated with the one or morefirst text segments “FT₁”, “FT₂” and “FT₃”, respectively. Collectively,the one or more first text segments associated with each of theplurality of categories 302 b are referred to as the plurality of firsttext segments 302 c. Table 1 depicts the association 300 a between theplurality of source domains 302 a, the plurality of categories 302 b,and the plurality of first text segments 302 c.

TABLE 1 Illustration of association between the plurality of sourcedomains, the plurality of categories and the plurality of first textsegments. Plurality of source Plurality of domains categories Pluralityof first text segments S₁ C₁ (FT₁ −> C₁) C₂ (FT₂ −> C₂) C₃ (FT₃ −> C₃)S₂ C₄ (FT₄ −> C₄), (FT₆ −> C₄) C₅ (FT₅ −> C₅) S₃ C₆ (FT₇ −> C₆) C₇ (FT₈−> C₇) C₈ (FT₉ −> C₈) C₉ (FT₁₀ −> C₉)

A person having ordinary skill in the art will understand the scope ofabovementioned Table 1 is for illustrative purpose and should not beconstrued to limit the scope of the disclosure.

FIG. 3B is a block diagram that illustrates a plurality of second textsegments corresponding to target domain. FIG. 3B is described inconjunction with FIG. 1, FIG. 2, and FIG. 3A. With reference to FIG. 3B,there is shown a block diagram that illustrates an exemplary association300 b between a plurality of second text segments and a target domain. Aperson with ordinary skills in the art will understand that for brevity,the plurality of second text segments 304 b includes seven second textsegments, “ST₁” to “ST₇”. Notwithstanding, the disclosure may not be solimited, and the plurality of source domains may include more than sevensecond text segments, without deviating from the scope of thedisclosure.

The target domain 304 a is associated with the plurality of second textsegments 304 b. The plurality of second text segments 304 b correspondsto unclassified data (i.e., the plurality of second text segments isindependent of the plurality of categories 302 b).

FIG. 4, depicts a flowchart that illustrates a method for dataprocessing for text classification, in accordance with at least oneembodiment. FIG. 4 is described in conjunction with FIG. 1, FIG. 2, FIG.3A and FIG. 3B. With reference to FIG. 4, there is shown a flowchart 400that illustrates a method for data processing for text classification. Aperson having ordinary skill in the art will understand that theexamples, as described in FIG. 4, are for illustrative purpose andshould not be construed limiting to the scope of the disclosure. Themethod starts at step 402 and proceeds to step 404.

At step 404, the plurality of first text segments and the plurality ofsecond text segments are retrieved. In an embodiment, the processor 202,in conjunction with the transceiver 206, may be configured to retrievethe plurality of first text segments and the plurality of second textsegments from the database server 106.

Prior to the retrieval of the plurality of first text segments and theplurality of second text segments, the transceiver 206 may receive aquery from a user, such as a service provider, for the classification ofthe plurality of second text segments corresponding to the targetdomain. The query may further comprise a count specified by the serviceprovider. Based on the target domain specified in the query, theprocessor 202 may be configured to retrieve the plurality of the secondtext segments from the database server 106. In another embodiment, theprocessor 202, in conjunction with the transceiver 206, may beconfigured to retrieve the plurality of second text segments from theone or more websites, over the network 108.

Further, based on the query, the processor 202 may be configured toidentify the plurality of source domains that is relevant to the targetdomain. The processor 202 may utilize one or more techniques known inthe art for the identification of relevant source domains. Examples ofthe one or more techniques for the identification of relevant sourcedomains may include, but are not limited to, syntactic similarity,lexical similarity, and/or semantic similarity. After the identificationof the plurality of relevant source domains, the transceiver 206 mayretrieve the plurality of first text segments corresponding to theplurality of source domains from the database server 106. Each of theplurality of first text segments is associated with a category in theplurality of categories associated with the plurality of source domains.For example, with reference to Table 1, the processor 202 may identify“S₁”, “S₂”, and “S₃”, as the relevant plurality of source domains for atarget domain “T₁” as specified in a query. Further, a first textsegment, such as “FT₃”, in the plurality of first text segmentscorresponding to the source domain “S₁” is associated with a category“C₃” in the plurality of categories (i.e., “C₁”, “C₂”, and “C₃”)associated with the source domain “S₁”.

After the retrieval, the processor 202 may be configured to determinethe score for each of the plurality of first text segments and each ofthe plurality of second text segments by utilizing the one or morescoring algorithms known in the art. Examples of the one or more scoringalgorithms are TF-IDF algorithm and/or the like. In an embodiment, afirst text segment in the plurality of first text segments may compriseone or more keywords. Further, the processor 202 may identify the scorefor each of the one or more keywords in each of the plurality of firsttext segments. Thus, the score associated with each of the plurality offirst text segments may correspond to a vector quantity.

At step 406, the plurality of clusters is generated from the pluralityof first text segments based on the association of the plurality offirst text segments with the plurality of categories. In an embodiment,the processor 202 may be configured to generate the plurality ofclusters from the plurality of first text segments based on theassociation of the plurality of first text segments with the pluralityof categories. For generating the plurality of clusters, the processor202 may tessellate the plurality of first text segments into theplurality of clusters based on the category associated with each of theplurality of first text segments. Thus, a cluster in the plurality ofclusters may be associated with a category in the plurality ofcategories. Further, the cluster constitutes the first text segmentsfrom the plurality of first text segments that are associated with thecategory associated with the cluster. For example, Table 2 illustratesthe plurality of clusters generated based on the plurality of first textsegments. with reference to Table 1.

TABLE 2 Illustration of a plurality of clusters generated from aplurality of first text segments Cluster Cluster_1 Cluster_2 Cluster_3Cluster_4 Cluster_5 Cluster_6 Cluster_7 Cluster_8 Cluster_9 Categoryassociated C₁ C₂ C₃ C₄ C₅ C₆ C₇ C₈ C₉ with the cluster First textsegments FT₁ FT₂ FT₃ FT₄, FT₅ FT₇ FT₈ FT₉ FT₁₀ in the cluster FT₆

With reference to Table 2, the count of clusters (i.e., “9”), in theplurality of clusters, is equal to the count of categories in theplurality of categories associated with the plurality of source domains(i.e., “S₁”, “S₂”, and “S₃”), with reference to Table 1.

At step 408, the centroid for each of the plurality of clusters isdetermined based on the score associated with one or more of theplurality of first text segments in each of the plurality of clusters.In an embodiment, the processor 202 may be configured to determine thecentroid for each of the plurality of clusters. In an embodiment, theprocessor 202 may utilize the score associated with the first textsegments in each of the plurality of clusters to determine the centroidfor each of the plurality of clusters. The processor 202 may determinethe centroid for each of the plurality of clusters by utilizing equation1, as shown below:

$\begin{matrix}{{Centorid}_{q} = {\frac{1}{q}{\sum\limits_{({{i = 1},{x_{i} \in q}})}^{q}x_{i}}}} & (1)\end{matrix}$

where,

x_(i) represents the score associated with a first text segment in acluster of the plurality of clusters;

∥q∥ represents a count of first text segments in a q^(th) cluster of theplurality of clusters;

Centorid_(q) represents a centroid for a first text segment of theq^(th) cluster in the plurality of clusters.

For example, with reference to Table 2, the processor 202 may determinea centroid for “Cluster_4” based on the score associated with the firsttext segments (i.e., “FT₄” and “FT₆”) in the “Cluster_4”. Similarly, thecentroid for each cluster in the plurality of clusters is determined.

A person having ordinary skill in the art will understand that the scopeof the abovementioned example is for illustrative purpose and should notbe construed to limit the scope of the disclosure.

In another embodiment, when the score associated with the first textsegments in each of the plurality of clusters corresponds to the vectorquantity, the processor 202 may determine the centroid of each of theplurality of clusters as the vector quantity. For example, withreference to Table 2, “Cluster_4” comprises two first text segments(i.e., “FT₄” and “FT₆”). Further, “FT₄” comprises three keywords (e.g.,“user”, “attentive” and “nature”) and “FT₆” comprises four keywords(e.g., “natural”, “response”, “attentive”, and “student”). In thisscenario, the keyword “attentive” is common to both the first textsegments, thus a count of unique keywords is six. Therefore, thecentroid of “Cluster_4” may correspond to a vector quantity comprisingsix centroid values, one for each of the unique keywords in the firsttext segments of the “Cluster_4”.

A person having ordinary skill in the art will understand that the scopeof the abovementioned example is for illustrative purpose and should notbe construed to limit the scope of the disclosure.

At step 410, the similarity score of each of the plurality of secondtext segments for each of the plurality of clusters is computed. In anembodiment, the processor 202 may be configured to compute thesimilarity score of each of the plurality of second text segments foreach of the plurality of clusters. In an embodiment, the processor 202may utilize the centroid associated with a cluster in the plurality ofclusters and the score associated with a second text segment, in theplurality of second text segments, to compute the similarity score ofthe second text segment for the cluster. The processor 202 may computethe similarity score by utilizing the one or more similarity measuresknown in the art. Examples of the one or more similarity measuresinclude, but are not limited to, cosine similarity, Euclidian distance,and KL divergence. The processor 202 may compute the similarity score byutilizing equation 2, as shown below:

$\begin{matrix}{{{Similarity}\mspace{14mu} {Score}\mspace{14mu} \left( {{centroid}_{q},{ST}_{i}} \right)} = \frac{{centroid}_{q} \cdot {ST}_{i}}{{{centroid}_{q}}{{ST}_{i}}}} & (2)\end{matrix}$

where,

centroid_(q) represents a centroid of a q^(th) cluster in the pluralityof clusters; ST_(i) represents the score associated with an i^(th)second text segment in the plurality of second text segments;

∥ST_(i)∥ represents count of keywords in the i^(th) second text segment;

∥centroid_(q)∥ represents count of centroid values in the centroid ofthe q^(th) cluster; and

Similarity Score (centroid_(q), ST_(i) represents a similarity score ofthe i^(th) second text segment for the q^(th) cluster.

After the computation of the similarity scores of each of the pluralityof second text segments for each of the plurality of clusters, theprocessor 202 may store the similarity scores as the tabular datastructure in the database server 106. For example, Table 3 illustrates atabular data structure for a plurality of second text segments in atarget domain “T₁” and a plurality of clusters determined from aplurality of first text segments associated with a plurality of sourcedomains “S₁”, “S₂”, and “S₃”.

TABLE 3 Illustration of the similarity scores of each of the pluralityof second text segments for each of the plurality of clusters. secondtext Clusters segments Cluster_1 Cluster_2 Cluster_3 Cluster_4 Cluster_5Cluster_6 Cluster_7 Cluster_8 Cluster_9 ST₁ 0.5  0.3 0.4 0.2 0.32 0.760.54 0.65 0.21 ST₂ 0.31 0.54 0.21 0.45 0.52 0.89 0.65 0.43 0.29 ST₃ 0.470.34 0.5 0.67 0.91 0.23 0.28 0.18 0.62 ST₄ 0.27 0.32 0.39 0.62 0.49 0.790.51 0.55 0.29 ST₅ 0.59 0.24 0.62 0.79 0.52 0.31 0.13 0.43 0.46 ST₆ 0.430.87 0.51 0.37 0.69 0.63 0.48 0.26 0.59 ST₇ 0/39 0.44 0.32 0.59 0.930.23 0.27 0.45 0.57

A person having ordinary skill in the art will understand that the scopeof the abovementioned example is for illustrative purpose and should notbe construed to limit the scope of the disclosure.

In an embodiment, the processor 202 may be configured to binarize thesimilarity scores stored in the tabular data structure. In anembodiment, the processor 202 may assign a value “1” for the highestsimilarity score corresponding to each of the plurality second textsegments and a value “0” to the remaining similarity scores in thetabular data structure. In an alternate embodiment, the processor 202may compare the computed similarity scores with a pre-specifiedthreshold. Based on the comparison, the processor 202 may assign thevalue “1” to the similarity scores that are greater than thepre-specified threshold and the value “0” to the similarity scores thatare less than or equal to the pre-specified threshold. For example,Table 4 illustrates the binarized similarity scores based on apre-specified threshold of “0.68”.

TABLE 4 Illustration of binarized similarity scores stored in thetabular data structure second text Clusters segments Cluster_1 Cluster_2Cluster_3 Cluster_4 Cluster_5 Cluster_6 Cluster_7 Cluster_8 Cluster_9ST₁ 0 0 0 0 0 1 0 0 0 ST₂ 0 0 0 0 0 1 0 0 0 ST₃ 0 0 0 0 1 0 0 0 0 ST₄ 00 0 0 0 1 0 0 0 ST₅ 0 0 0 1 0 0 0 0 0 ST₆ 0 1 0 0 1 0 0 0 0 ST₇ 0 0 0 01 0 0 0 0

A person having ordinary skill in the art will understand that the scopeof the abovementioned example is for illustrative purpose and should notbe construed to limit the scope of the disclosure.

At step 412, the pre-specified count of clusters is identified from theplurality of clusters based on the computed similarity score. In anembodiment, the processor 202 may be configured to identify thepre-specified count of clusters from the plurality of clusters based onthe computed similarity score. In an embodiment, the identifiedpre-specified count of clusters encompasses the maximum count of theplurality of second text segments. The processor 202 may utilize one ormore algorithms known in the art for the identification of thepre-specified count of clusters from the plurality of clusters. Examplesof such one or more algorithms may include maximum coverage algorithm,greedy algorithm, and/or the like.

In an exemplary scenario, a service provider may specify a count ofclusters as “2”. With reference to Table 4, the count of clusters in theplurality of clusters is “9”. Thus, the processor 202 is configured toidentify “2” clusters from “9” clusters, such that the two clustersencompass the maximum count of the plurality of second text segments.Based on the similarity score, the processor 202 may identify that“Cluster_5” and “Cluster_6” collectively encompass “6” out of “7” secondtext segments. Further, the count of the plurality of second textsegments encompassed by any other combination of “2” clusters in theplurality of clusters is less than “6”. Thus, the processor 202 mayidentify “Cluster_5” and “Cluster_6” as the pre-specified count ofclusters from the plurality of clusters.

A person having ordinary skill in the art will understand that the scopeof the abovementioned exemplary scenario is for illustrative purpose andshould not be construed to limit the scope of the disclosure.

In an embodiment, each of the pre-specified count of clusters may beassociated with a category. For example, the “Cluster_5” and “Cluster_6”(i.e., the identified pre-specified count of clusters) are associatedwith categories “C₅” and “C₆”, respectively (with reference to Table 2).

In an embodiment, the first text segments in the identifiedpre-specified count of clusters may correspond to the training set. Inan embodiment, the processor 202, in conjunction with the textcategorizer 208 may be configured to determine the weight for one ormore of the plurality of first text segments (i.e., the training set)associated with the identified pre-specified count of clusters by use ofthe second classifier.

In an exemplary implementation, the text categorizer 208 may assign alabel, such as “−1”, to each of the first text segments (i.e., thetraining set) associated with the identified pre-specified count ofclusters. Further, the text categorizer 208 may assign a label, such as“+1”, to each of the plurality of second text segments. Thereafter, thetext categorizer 208 may train the second classifier by utilizing thelabeled the first text segments and the labeled plurality of second textsegments. In an embodiment, the text categorizer 208 may utilize thetrained second classifier to determine the weights for each of the firsttext segments associated with the identified pre-specified count ofclusters. In an embodiment, the trained classifier may determine ahigher weight for a first text segment, associated with thepre-specified count of clusters, which is similar to the plurality ofsecond text segments. The trained classifier may determine a lowerweight for a first text segment, associated with the pre-specified countof clusters, which is dissimilar to the plurality of second textsegments.

The second classifier may determine the weights for each of theplurality of first text segments by utilizing equation 3, as shownbelow:

$\begin{matrix}{w_{x} = \frac{\left( {P_{t}\left( {\left. x \middle| d \right. = {target}} \right)} \right)}{\left( {P_{s}\left( {\left. x \middle| d \right. = {training}} \right)} \right)}} & (3)\end{matrix}$

where,

P_(t)(x|d=target) represents a probability with which the secondclassifier classifies a training set element (i.e., assigns a “+1” labelto a first text segment associated with the pre-specified count ofclusters) to the target domain;

P_(t)(x|d=training) represents a probability with which the secondclassifier classifies the training set element (i.e., assigns a “−1”label to the first text segment associated with the pre-specified countof clusters) to the training set; and

w_(x) represents a weight assigned to the training set element (i.e.,the first text segment associated with the pre-specified count ofclusters).

In an exemplary scenario, the trained classifier may assign the label“−1” to a first text segment, such as “FT₅”, with reference to Table 2,associated with the pre-specified count of clusters (i.e., “Cluster_5”,and “Cluster_6”) with a probability of “0.78” and may assign the label“+1” to the first text segment “FT₅” with a probability of “0.22”. Thefirst text segment “FT₅” is dissimilar to the plurality of the secondtext segments. In this scenario, the weight assigned by the secondclassifier to the first text segment associated with the pre-specifiedcount of clusters is “0.282”. The trained classifier may further assignthe label “−1” to a first text segment, such as “FT₇” with reference toTable 2, associated with the pre-specified count of clusters (i.e.,“Cluster_5”, and “Cluster_6”) with a probability of “0.52” and mayassign the label “+1” to the first text segment “FT₇” with a probabilityof “0.48”. The first text segment “FT₇” is similar to the plurality ofthe second text segments. In this scenario, the weight assigned by thesecond classifier to the first text segment associated with thepre-specified count of clusters is “0.923”.

A person having ordinary skill in the art will understand that the scopeof the abovementioned exemplary scenario is for illustrative purpose andshould not be construed to limit the scope of the disclosure.

At step 414, the first classifier is trained by utilizing the first textsegments in the identified pre-specified count of clusters, wherein thetrained first classifier is utilized to automatically classify theplurality of second text segments. In an embodiment, the textcategorizer 208, in conjunction with the processor 202, may beconfigured to train the first classifier by utilizing the first textsegments in the identified pre-specified count of clusters. The textcategorizer 208 may extract one or more features, known in the art, fromthe first text segments in the identified pre-specified count ofclusters (i.e., the training set) to train the first classifier.Examples of the one or more features may include lexical features,syntactic features, semantic features, Bag of words features, and/or thelike.

In another embodiment, the text categorizer 208 may utilize the weightedfirst text segments associated with the pre-specified count of clustersto train the first classifier. Thereafter, the text categorizer 208 mayutilize the trained first classier to classify each of the plurality ofthe second text segments into categories associated with thepre-specified count of clusters. For example, the text categorizer 208may utilize the trained first classifier to classify the plurality ofsecond text segments corresponding to the target domain “T₁” into thecategories (i.e., “C₅” and “C₆”) associated with the pre-specifiedcount, “2”, of clusters (i.e., “Cluster_5” and “Cluster_6”).

A person having ordinary skill in the art will understand that the scopeof the abovementioned example is for illustrative purpose and should notbe construed to limit the scope of the disclosure.

Then, the control passes to end step 416.

FIG. 5A is a block diagram that illustrates an exemplary scenario fortraining the first classifier for text classification of the targetdomain, in accordance with at least one embodiment. FIG. 5A has beenexplained in conjunction with FIGS. 1-4. With reference to FIG. 5A,there is shown an exemplary scenario 500 a for training the firstclassifier for text classification of the target domain.

Based on a query received from a user-computing device 102, theapplication server 104 may retrieve a plurality of first text segments502 corresponding to a plurality of source domains (i.e., “S₁”, “S₂”,and “S₃”) from the database server 106. In an embodiment, the query maybe received from a user associated with the user-computing device 102,such as a service provider, who wants to classify a plurality of secondtext segments 504 into a specific count of categories. The plurality ofsecond text segments 504 may be associated with the target domain “T₁”that corresponds to a product/service provided by the service provider.Thus, the received query comprises the specific count specified by theservice provider.

Further, the application server 104 may retrieve the plurality of secondtext segments 504 corresponding to the target domain “T₁” from thedatabase server 106. A first text segment, such as “FT₁”, of theplurality of first text segments 502 is associated with a category, suchas “C₁”, of the plurality of categories. In an embodiment, theapplication server 104 may be configured to determine the score for eachof the plurality of first text segments 502 and the plurality of secondtext segments 504. Thereafter, the application server 104 may clusterthe plurality of first text segments 502 into the plurality of clusters506. The plurality of clusters 506 is generated from the plurality offirst text segments 502 based on the association of the plurality offirst text segments 502 with the plurality of categories. The pluralityof clusters 506 comprises clusters 506 a to 506 i. Each of the pluralityof clusters 506 is associated with a category of the plurality ofcategories. Further, first text segments that are associated with a samecategory are in the same cluster. For example, the cluster 506 d isassociated with category “C₄”, and “FT₄” and “FT₆” are associated withcategory “C₄”. Thus, “FT₄” and “FT₆” are in the same cluster 506 d.

Thereafter, the application server 104 may compute the similarity score508 of each of the plurality of second text segments 504 for each of theplurality of clusters 506. The application server 104 may store thesimilarity scores as a tabular data structure 508 a in the databaseserver 106.

Further, the application server 104 may identify the pre-specified countof clusters 510 from the plurality of clusters 506 based on the computedsimilarity scores 508. The count of the pre-specified count of clustersis specified in the received query. The pre-specified count of clusters510 comprises two clusters (i.e., 506 e and 506 f). The pre-specifiedcount of clusters 510 encompasses the maximum count of the plurality ofsecond text segments 504. The application server 104 may utilize thefirst text segments (i.e., “FT₅” and “FT₇”) associated with thepre-specified count of clusters 510 to train the first classifier 512.

In an embodiment, the application server 104 may utilize the secondclassifier to assign weights to the first text segments (i.e., “FT₅” and“FT₇”) associated with the pre-specified count of clusters 510.Thereafter, application server 104 may utilize the weighted first textsegments (i.e., “FT₅” and “FT₇”) associated with the pre-specified countof clusters 510 to train the first classifier 512.

FIG. 5B is a block diagram that illustrates an exemplary scenario forthe classification of the plurality of second text segments by utilizingthe trained first classifier, in accordance with at least oneembodiment. FIG. 5B has been explained in conjunction with FIGS. 1-5A.With reference to FIG. 5B, there is shown an exemplary scenario 500 bfor the classification of the plurality of second text segments byutilizing the trained first classifier 512.

The application server 104 may utilize the trained first classifier 512for classifying each of the plurality of second text segments 504 intothe categories associated with the pre-specified count “2” of clusters510 (i.e., “C₅” and “C₆”). Thereafter, the application server 104 maytransmit the classified plurality of second text segments 514 to theuser-computing device 102 associated with the service provider. Theapplication server 104 may further store the classified plurality ofsecond text segments 514 in the database server 106.

A person having ordinary skill in the art will understand that the scopeof the abovementioned exemplary scenario is for illustrative purpose andshould not be construed to limit the scope of the disclosure.

The disclosed embodiments encompass numerous advantages. The disclosureprovides a method and a system for text classification of a targetdomain. The disclosed method and system utilizes a plurality of firsttext segments, corresponding to a plurality of source domains,associated with a plurality of categories to classify a plurality ofsecond text segments corresponding to the target domain. Thus, thedisclosed method and system enables multi-source cross-domainclassification of text segments. The disclosed method and system reducesan overhead to manually classify the second text segments associatedwith the target domain to generate a training set. The disclosed methodand system automatically generates a training set for the target domain,without requiring any human intervention, by utilizing pre-classifiedtext segments associated with the plurality of source domains. Each ofthe plurality of source domains contribute partially in the generationof the training set for training the classifier to classify theplurality of second text segments.

The disclosed methods and systems, as illustrated in the ongoingdescription or any of its components, may be embodied in the form of acomputer system. Typical examples of a computer system include ageneral-purpose computer, a programmed microprocessor, amicro-controller, a peripheral integrated circuit element, and otherdevices, or arrangements of devices that are capable of implementing thesteps that constitute the method of the disclosure.

The computer system comprises a computer, an input device, a displayunit, and the internet. The computer further comprises a microprocessor.The microprocessor is connected to a communication bus. The computeralso includes a memory. The memory may be RAM or ROM. The computersystem further comprises a storage device, which may be a HDD or aremovable storage drive such as a floppy-disk drive, an optical-diskdrive, and the like. The storage device may also be a means for loadingcomputer programs or other instructions onto the computer system. Thecomputer system also includes a communication unit. The communicationunit allows the computer to connect to other databases and the internetthrough an input/output (I/O) interface, allowing the transfer as wellas reception of data from other sources. The communication unit mayinclude a modem, an Ethernet card, or other similar devices that enablethe computer system to connect to databases and networks, such as, LAN,MAN, WAN, and the internet. The computer system facilitates input from auser through input devices accessible to the system through the I/Ointerface.

To process input data, the computer system executes a set ofinstructions stored in one or more storage elements. The storageelements may also hold data or other information, as desired. Thestorage element may be in the form of an information source or aphysical memory element present in the processing machine.

The programmable or computer-readable instructions may include variouscommands that instruct the processing machine to perform specific tasks,such as steps that constitute the method of the disclosure. The systemsand methods described can also be implemented using only softwareprogramming or only hardware, or using a varying combination of the twotechniques. The disclosure is independent of the programming languageand the operating system used in the computers. The instructions for thedisclosure can be written in all programming languages, including, butnot limited to, ‘C’, ‘C++’, ‘Visual C++’ and ‘Visual Basic’. Further,software may be in the form of a collection of separate programs, aprogram module containing a larger program, or a portion of a programmodule, as discussed in the ongoing description. The software may alsoinclude modular programming in the form of object-oriented programming.The processing of input data by the processing machine may be inresponse to user commands, the results of previous processing, or from arequest made by another processing machine. The disclosure can also beimplemented in various operating systems and platforms, including, butnot limited to, ‘Unix’, ‘DOS’, ‘Android’, ‘Symbian’, and ‘Linux’.

The programmable instructions can be stored and transmitted on acomputer-readable medium. The disclosure can also be embodied in acomputer program product comprising a computer-readable medium, or withany product capable of implementing the above methods and systems, orthe numerous possible variations thereof.

Various embodiments of the methods and systems for data processing fortext classification of a target domain have been disclosed. However, itshould be apparent to those skilled in the art that modifications inaddition to those described are possible without departing from theinventive concepts herein. The embodiments, therefore, are notrestrictive, except in the spirit of the disclosure. Moreover, ininterpreting the disclosure, all terms should be understood in thebroadest possible manner consistent with the context. In particular, theterms “comprises” and “comprising” should be interpreted as referring toelements, components, or steps, in a non-exclusive manner, indicatingthat the referenced elements, components, or steps may be present, orused, or combined with other elements, components, or steps that are notexpressly referenced.

A person with ordinary skills in the art will appreciate that thesystems, modules, and sub-modules have been illustrated and explained toserve as examples and should not be considered limiting in any manner.It will be further appreciated that the variants of the above disclosedsystem elements, modules, and other features and functions, oralternatives thereof, may be combined to create other different systemsor applications.

Those skilled in the art will appreciate that any of the aforementionedsteps and/or system modules may be suitably replaced, reordered, orremoved, and additional steps and/or system modules may be inserted,depending on the needs of a particular application. In addition, thesystems of the aforementioned embodiments may be implemented using awide variety of suitable processes and system modules, and are notlimited to any particular computer hardware, software, middleware,firmware, microcode, and the like.

The claims can encompass embodiments for hardware and software, or acombination thereof.

It will be appreciated that variants of the above disclosed, and otherfeatures and functions or alternatives thereof, may be combined intomany other different systems or applications. Presently unforeseen orunanticipated alternatives, modifications, variations, or improvementstherein may be subsequently made by those skilled in the art, which arealso intended to be encompassed by the following claims.

What is claimed is:
 1. A method of data processing for textclassification of a target domain, the method comprising: generating, byone or more processors, a plurality of clusters from a plurality offirst text segments corresponding to a plurality of source domains,based on an association of the plurality of first text segments with aplurality of categories, wherein a cluster in the plurality of clustersis associated with a category in the plurality of categories; computing,by the one or more processors, a similarity score of each of a pluralityof second text segments corresponding to the target domain for each ofthe plurality of clusters; identifying, by the one or more processors, apre-specified count of clusters from the plurality of clusters, based onthe computed similarity score, wherein the identified pre-specifiedcount of clusters encompasses maximum count of the plurality of secondtext segments; and training, by the one or more processors, a firstclassifier by utilizing first text segments in the identifiedpre-specified count of clusters, wherein the trained first classifier isutilized to automatically classify the plurality of second text segmentsinto categories associated with the identified pre-specified count ofclusters.
 2. The method of claim 1, further comprising retrieving, bythe one or more processors, the plurality of first text segments and theplurality of second text segments, wherein a first text segment in theplurality of first text segments is associated with a category of theplurality of categories, and wherein the plurality of second textsegments is independent of the plurality of categories.
 3. The method ofclaim 1, further comprising determining, by the one or more processors,a centroid for each of the plurality of clusters based on a scoreassociated with one or more of the plurality of first text segments ineach of the plurality of clusters.
 4. The method of claim 3, wherein thesimilarity score is computed based on the centroid of each of theplurality of clusters and the score associated with each of theplurality of second text segments.
 5. The method of claim 1, wherein thecomputed similarity score is stored as a tabular data structure, whereineach element in a row of the tabular data structure represents thesimilarity score between a second text segment in the plurality ofsecond text segments and a cluster in the plurality of clusters.
 6. Themethod of claim 1, wherein the identification of the pre-specified countof clusters is based on a maximum coverage technique.
 7. The method ofclaim 1, further comprising determining, by the one or more processors,a weight for one or more of the plurality of first text segmentsassociated with the identified pre-specified count of clusters by use ofa second classifier.
 8. The method of claim 1, wherein the firstclassifier is trained by utilizing the weighted one or more of theplurality of first text segments to automatically classify the pluralityof second text segments into the categories associated with theidentified pre-specified count of clusters.
 9. A system for dataprocessing for text classification of a target domain, the systemcomprising: one or more processors configured to: generate a pluralityof clusters from a plurality of first text segments corresponding to aplurality of source domains, based on an association of the plurality offirst text segments with a plurality of categories, wherein a cluster inthe plurality of clusters is associated with a category in the pluralityof categories; compute a similarity score of each of a plurality ofsecond text segments corresponding to the target domain for each of theplurality of clusters; identify a pre-specified count of clusters fromthe plurality of clusters, based on the computed similarity score,wherein the identified pre-specified count of clusters encompassesmaximum count of the plurality of second text segments; and train afirst classifier by utilizing first text segments in the identifiedpre-specified count of clusters, wherein the trained first classifier isutilized to automatically classify the plurality of second text segmentsinto categories associated with the identified pre-specified count ofclusters.
 10. The system of claim 9, wherein the one or more processorsare further configured to retrieve the plurality of first text segmentsand the plurality of second text segments, wherein a first text segmentin the plurality of first text segments is associated with a category ofthe plurality of categories, and wherein the plurality of second textsegments is independent of the plurality of categories.
 11. The systemof claim 9, wherein the one or more processors are further configured todetermine a centroid for each of the plurality of clusters based on ascore associated with one or more of the plurality of first textsegments in each of the plurality of clusters.
 12. The system of claim11, wherein the similarity score is determined based on the centroid ofeach of the plurality of clusters and the score associated with each ofthe plurality of second text segments.
 13. The system of claim 9,wherein the computed similarity score is stored as a tabular datastructure, wherein each element in a row of the tabular data structurerepresents the similarity score between a second text segment in theplurality of second text segments and a cluster in the plurality ofclusters.
 14. The system of claim 9, wherein the identification of thepre-specified count of clusters is based on a maximum coveragetechnique.
 15. The system of claim 9, wherein the one or more processorsare further configured to determine a weight for one or more of theplurality of first text segments associated with the identifiedpre-specified count of clusters by use of a second classifier.
 16. Thesystem of claim 15, wherein the first classifier is trained by utilizingthe weighted one or more of the plurality of first text segments toautomatically classify the plurality of second text segments into thecategories associated with the identified pre-specified count ofclusters.
 17. A computer program product for use with a computer, thecomputer program product comprising a non-transitory computer readablemedium, wherein the non-transitory computer readable medium stores acomputer program code for data processing for text classification of atarget domain, wherein the computer program code is executable by one ormore processors to: generate a plurality of clusters from a plurality offirst text segments corresponding to a plurality of source domains,based on an association of the plurality of first text segments with aplurality of categories, wherein a cluster in the plurality of clustersis associated with a category in the plurality of categories; compute asimilarity score of each of a plurality of second text segmentscorresponding to the target domain for each of the plurality ofclusters; identify a pre-specified count of clusters from the pluralityof clusters, based on the computed similarity score, wherein theidentified pre-specified count of clusters encompass maximum count ofthe plurality of second text segments; and train a first classifier byutilizing first text segments in the identified pre-specified count ofclusters, wherein the trained first classifier is utilized toautomatically classify the plurality of second text segments intocategories associated with the identified pre-specified count ofclusters.